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Abstract. An a< rodynamic design optimization procedure that is based on a evolu- 
tionary algorithm known at Differential Evolution is described. Differential Evolution 
is a simple, fast, md robust evolutionary strategy that has been proven effective in 
determining the global optimum for several difficult optimization problems, including 
highly nonlinear s /stems with discontinuities and multiple local optima. The method is 
combined with a 'Javier-Stokes solver that evaluates the various intermediate designs 
and provides inputs to the optimization procedure. An efficient constraint handling 
mechanism is also incorporated. Results are presented for the inverse design of a tur- 
bine airfoil from a modern jet engine. The capability of the method to search large 
design spaces and obtain the optimal airfoils in an automatic fashion is demonstrated. 
Substantial reductions in the overall computing time requirements are achieved by 
using the algorith n in conjunction with neural networks. 


1 Introduction 

Remarkable progress has been made in recent years in the ability to design tur- 
bomachinery airloil shapes that are optimal with regard to certain desired char- 
acteristics. This >rogress has been achieved by combining improved methods for 
predicting the complicated flow fields in turbomachinery with efficient numerical 
optimization techniques and by harnessing the powerful capabilities of modern 
computers. Both steady and unsteady Navier-Stokes and Euler solvers have been 
combined with various optimization techniques (gradient-based methods [1], [2], 
response surfaces, etc.) to optimize the design of turbomachinery airfoils. 

More recenth , there has been considerable interest in the development of tur- 
bomachinery airfoil design optimization techniques that are based on nontradi- 
tional approaches such as evolutionary algorithms and neural networks. Various 
approaches based on neural networks (see, for example, [3], [4], [5]), neural net- 
works in conjunction with response surfaces [6], [7], genetic algorithms [8], [9], 
and genetic algorithms in conjunction with neural networks [10], [11], [12] have 
been reported in the literature. These techniques offer several advantages over 
traditional optin ization methods. 

This paper deals with the development of a turbomachinery airfoil design 
optimization pro -.edure that is based on a relatively new evolutionary algorithm 
known as Differe itial Evolution [13] developed for single-objective optimization 
in continuous search spaces. It is conceptually simple and possesses good conver- 
gence properties that have been demonstrated in a variety of applications. Dif- 
ferential Evolutinti (DE) is best characterized as an evolutionary strategy (ES) 
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rather than as a genetic algorithm (GA), although the distinction between GAs 
and ESs has blurred in recent years. Perhaps the main ideological difference lies 
in the relative importance given to the two main evolutionary operators, recom- 
bination (crossover) and mutation, with GA-based approaches relying heavily 
on the former at id ES-based approaches on the latter. DE has proven to be an 
effective approat h in determining the global optimum for several difficult opti- 
mization problems in a variety of applications. Its application in aeronautics, 
however, has been rather limited. It has been used in the predictive control of 
aircraft dynamic s [14]. DE has been used in conjunction with a potential flow 
solver in the inverse design of turbomachinery airfoils [15]; the same authors 
have also presented a hybridized version [16] that combined DE with a local 
search method t > minimize the number of objective function evaluations using 
the potential flow solver. 

In this paper the DE algorithm is combined with a Navier-Stokes solver 
that provides in] aits to the optimization procedure. An efficient constraint han- 
dling mechanism is also incorporated in the algorithm. An airfoil geometry 
parametrization hat uses a minimal number of variables is also used to minimize 
the number of objective function evaluations. The procedure is also combined 
with neural networks that are incrementally trained on the Navier-Stokes sim- 
ulation data am can then be used in the objective function evaluation. This 
results in substantial reductions in the overall computing time. Additionally, 
the procedure has been implemented on a distributed parallel computer in a 
straightforward manner that relies on the simultaneous computation of multi- 
ple, independent aerodynamic simulations on separate processors. The procedure 
is primarily script-based and allows for a variable number of processors to be 
used depending <>n the size of the population used in the DE algorithm. Details 
of the method and its implementation and results for the inverse design of a 
turbine airfoil to demonstrate its capabilities are described. 


2 Design Optimization Method 

The main ingredi tints of the design optimization method are discussed in this sec- 
tion. The DE algorithm, the airfoil geometry parametrization procedure, and the 
CFD flow solver used for evaluating the objective function are discussed briefly. 
Some details reg; rding the implementation of the method on parallel distributed 
computers are aTo provided. A hybrid version that helps reduce computational 
cost by combining he DE algorithm with a neural network approach is also 
described. 

2.1 Differential Evolution 

Differential Evolt \ ion is an ES-based approach developed for single-objective op- 
timization in continuous search spaces. It is conceptually simple and possesses 
good convergence properties that have been demonstrated in a variety of appli- 
cations [18]. Details of the algorithm can be found elsewhere [13], [17]; only its 
main features ar< summarized here. 
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The approach uses a population P® that contains N AT-dimensional real- 
valued parameter vectors in generation Q, where K is the number of parameters 
or decision variables: 


pQ = P® = pf k , i = 1 , N ; k = l,...,K ( 1 ) 

The populate >n is usually initialized in a random fashion and the population 
size N is maintained constant throughout the optimization process. Differential 
evolution is thur similar to a (/i + A) ES [19] with fi and A equal to N [20]. 
The method however differs from standard ES approaches in several respects as 
described below. 

As with all ES-based approaches, mutation is the key ingredient of differential 
evolution. The b< sic idea is to generate new parameter vectors for the subsequent 
generation by us ng weighted differences between two (or more) parameter vec- 
tors selected randomly from the current population to provide appropriately 
scaled perturbations that modify another parameter vector (or, comparison vec- 
tor) selected fro n the same population. This idea has been implemented in 
various forms bu the form discussed and used here is the classical implementa- 
tion where new 1 rial parameter vectors P for the next generation Q + 1 are 
generated according to the following mutation scheme: 


v Q+1 

Pi t k 




,K 


( 2 ) 


where 


fl, 6, cE{ 1, ...,1V} ; di y^bi ^ Ci ^ i 

The integers i , 7 , and c* represent three random individuals of the popu- 
lation that are n utually different from each other and from the running index 
i. The mutation parameter F € [0,2] is a real, constant, user-supplied param- 
eter that controls the amplification of the differential variation. Other variants 
that either use the difference between more than two parameter vectors or keep 
track of the best parameter vector at each generation and use it in the mutation 
scheme have also been developed [9] and used with varying success in specific 
applications. Thus, differential evolution differs from other ESs most notably in 
that the mutatio i operator is derived from the current population and not by 
probability density functions that are defined separately. 

DE is similar to other recombinative ES approaches in that it also uses dis- 
crete recombination. While various recombination strategies exist [19] the strat- 
egy adopted in referential evolution is to modify the trial parameter vectors 
P^ 1 as follows: 


Pi,k — Pi,k 


if r i}k <C r or k = d k 


( 4 ) 


and 


PiP = P?,k otherwise 


( 5 ) 
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In the above, r £ [0, 1] is a uniform random number, C r € [0, 1] is the 
crossover parann ter, and d k is a randomly chosen index in {1, ..., K} that ensures 
that pf k l gets at least one parameter from the mutated pf ^ 1 and not all from 

pf k . Note also that the mutation and recombination operations described above 
can lead to new vectors that may fall outside the boundaries of the variables. 
Various repair rules can be used to ensure that these inadmissible vectors do 
not enter the population. A simple strategy, which is the one adopted here, is 
to delete these inadmissible vectors and form new ones until the population is 
filled. 

The selection scheme used in DE is deterministic but differs from methods 
usually employed in standard ES approaches. Selection is based on local com- 
petition only, with the child trial vector (or, child) competing against one 

population member P® (the comparison vector) and the survivor entering the 
new population Q f ,+1 . In other words, if P® +1 yields a better objective func- 
tion value than pf* then P® +1 is set to P^ +1 . Otherwise, the old value P® is 
retained. This greedy selection criterion results in fast convergence; the adaptive 
nature of the mutation operator, in general, helps safeguard against premature 
convergence and allows the process to extricate itself from local optima. 

An efficient constraint handling mechanism has been incorporated into the 
algorithm. Details are given elsewhere; briefly, it is a parameter-less penalty 
function approar h where infeasible solutions are penalized and help guide the 
algorithm away from these regions. Physical constraints, e.g., maximum airfoil 
thickness, etc., are imposed, as well as aerodynamic constraints (wavy surfaces, 
etc.). Airfoil geometries that meet the constraints but for which the CFD solver 
is unable to converge or ’’blows up” are also deemed infeasible and penalized 
accordingly. 

2.2 Airfoil Geometry Parametrization 

Geometry parametrization and prudent selection of design variables are among 
the most critical aspects of any shape optimization procedure. The ability to rep- 
resent various airfoil geometries with a common set of geometrical parameters 
is essential. Variations of the airfoil geometry can be obtained then by smoothly 
varying these paiameters. Geometrical constraints imposed for various reasons, 
such as structural, aerodynamic (e.g., to eliminate flow separation), etc., should 
be included in this parametric representation as much as possible. Addition- 
ally, the smallest number of parameters should be used to represent the family 
of airfoils. Here, the airfoil geometry parametrization method described in [6] 
that uses a total of 13 parameters to define the turbine airfoil geometry is used. 
Figure 1 illustrates the method for a generic airfoil. The geometric parameters 
used are the leading edge and trailing edge airfoil metal angles (2 parameters), 
eccentricity of upper leading edge ellipse (1 parameter), angles defining the ex- 
tent of the leading edge ellipses (2 parameters), semi-minor axes values at the 
leading edge (2 parameters), angles defining the extent of the trailing edge circle 
(2 parameters), airfoil y-coordinate values at about 50% chord on the upper and 
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lower surfaces (2 parameters), and airfoil y-coordinate values at about 25% and 
75% chord on tb-‘ upper surface (2 parameters). 


2.3 Flow Soher for Objective Function Evaluation 

A two-dimensional Navier-Stokes solver is used to perform the flow simulations 
(direct function valuations) that serve as inputs to the optimization process. 
Multiple grids an 1 used to discretize the flow domain; an inner ”0” grid that con- 
tains the airfoil and an outer ”H” grid that conforms to the external boundaries 
as shown in Fig. 3. The flow parameters that are specified are the turbine pres- 
sure ratio, inlet temperature and flow angle, flow coefficient, and unit Reynolds 
number based on inlet conditions. 


2.4 Parallel ] uplementation Details 

In order to redu< e overall design time, the procedure has been implemented on 
distributed parallel computers. The results in this article were obtained on the 
SGI Origin 3000 and the Cray SV1 at NASA Ames Researach Center. The imple- 
mentation of the method is quite straightforward and relies on the simultaneous 
computation of multiple, independent aerodynamic simulations on separate pro- 
cessors. The proc edure is primarily script-based and allows for a variable number 
of processors to be used depending on processor availability and the size of the 
population used in the DE algorithm. The number of processors can also be 
adjusted as the design proceeds. The current setup is based on a master-slave 
arrangement, with the master handling the tasks of setting up the simulations, 
neural network training for the hybrid method, and farming out of the aero- 
dynamic comput it ions to the other "slave” processors. Since the aerodynamic 
computations an independent of each other, no communication between the pro- 
cessors is required until the computations are completed. The slave processors 
then communicate rheir results to the master which then performs the necessary 
calculations to determine the members of the next population. 


2.5 Hybrid Differential Evolution— Neural Network (DE-NN) 
Approach 

While the DE algorithm is quite efficient in terms of exploring the entire design 
space in its seard for the optimum solution, there is a tendency for the algorithm 
to slow r down aft< r it approaches the vicinity of the optimal solution and several 
function evaluations are required in order to obtain the exact optimal solution. 
This can be remedied by a hybrid approach that combines the DE algorithm with 
neural networks that are incrementally trained on the Navier-Stokes simulation 
data. The traine 1 neural network can then be used to evaluate the objective 
function evaluation with little or no computational expense instead of using the 
Navier-Stokes solver. While hybridization is always useful, it must be done with 
caution. Here we resort to it only in the latter stages after the entire population 
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has evolved to i he general vicinity of the optimal solution. Thus the neural 
network is used as a ’’local” response surface with validity only in a small region 
of the design spa( e. This makes it easier to train the neural network and improves 
its generalization abilities. 

The results o >t ained in this article were obtained using a feed-forv/ard neu- 
ral network with two hidden layers as shown in Fig. 3. The first node in the 
input layer is a bias node (input of 1.0) and the remaining input nodes are used 
to specify the v; nous design parameters. For the inverse design optimization 
problem, the neural network is trained on the sum-of-squares error between the 
actual pressure and the target pressure at various points on the airfoil. For the 
sake of brevity, details such as the number of neurons in each layer, etc. are not 
included here. 


3 Results 

The design method was used in the inverse design of a turbine airfoil with a 
specified pressure distribution. The target pressure distribution was obtained 
at the midspan '4 a turbine vane from a modern jet engine and was supplied 
by Pratt and Whitney (Private Communication, F. Huber, 1997). Several flow 
and geometry parameters were also supplied and used in the design process. The 
design objective function was formulated as the equally- weighted sum-of-squares 
error between th ' target and actual pressure obtained during the optimization 
process at 45 locations on the airfoil. 

The initial design space was chosen to be quite large to allow for a wide range 
of airfoil shapes i ) be explored. In order to hold the CFD function evaluations to 
a reasonable number, 6 (instead of 13) design variables were used in the initial 
stages of the desi gn. The population of 50 members were then evolved using the 
DE algorithm. Toe DE mutation and crossover parameters were both chosen to 
be 0.8 based on orior experience with other problems; no attempts were made 
to optimize thesr parameters. Figure 4 shows the pressure distribution for an 
intermediate airfnil that represents the best airfoil obtained after 10 generations 
using the DE optimization method. The algorithm is able to approach the tar- 
get distribution within roughly 500 function evaluations (note that the actual 
number of function evaluations is much less, because many of the initial airfoil 
geometries that were infeasible were not evaluated by the CFD solver. After 10 
generations, the number of design variables is increased to 13 and the popu- 
lation evolved fu t.her. As is typical with other genetic algorithms, once in the 
vicinity of the optimal solution, convergence of the DE algorithm slows down 
considerably. Th«‘ final design shown in Fig. 5 was obtained after another 10 
generations. 

In order to n duce the computational cost of the CFD function evaluations 
the population after the first 10 generations was used to train a neural network. 
Figure 6 shows 1 lie band around the target pressure distribution in which all 
the data used to train the neural network lie. Note, however, that the network 
was trained direc 1> on the sum-square-error and not on the individual pressure 
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data. The data >nnd in Fig. 6 gives an idea of the local nature of the neural 
network respons ; surface in the vicinity of the optimal solution. The trained 
neural network was used in lieu of the CFD solver to perform the function 
evaluation with negligible computational cost. The final design obtained was 
close to that shown in Fig. 5. Finally, Fig. 7 shows the optimal airfoil geometry 
obtained by the DE algorithm. 

Attempts to quantify the computational costs and obtain more detailed eval- 
uation of the vaiious parameters are currently underway. 


4 Summary 

An aerodynamic design optimization procedure that is based on a evolutionary 
algorithm known at Differential Evolution is described. The method is combined 
with a Navier-Si >kes solver that evaluates the various intermediate designs and 
provides inputs U> the optimization procedure. Results are presented for the 
inverse design oi a turbine airfoil from a modern jet engine. The capability of 
the method to search large design spaces and obtain the optimal airfoils with 
a reasonable number of CFD function evaluations in an automatic fashion is 
demonstrated. "I he airfoil geometry parametrization and constraint handling 
procedure helps imit the number of CFD function evaluations required by dis- 
allowing airfoil geometries that are infeasible from a physical or aerodynamic 
standpoint. Substantial reductions in the overall computing time requirements 
are achieved by 1 he hybrid DE-NN algorithm that uses a neural network trained 
on the CFD dat a to evaluate the objective function in the latter stages of the 
design evolution 
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Figure 1 . Schen atic of a generic airfoil showing location of control points on the 
airfoil surface a id the defining angles used in the parameterization of the airfoil 
geometry. 



Outer H-Grid 


Inner O-Grid 


Figure 2. Representative turbine airfoil geometry and 
con putational grid used in the CFD simulations. 
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Layer 1 Layer 2 



Hidden Layers 


Figure 3. Schematic of the three-layer feed- forward 
neural network used in this study. 



Figure 4. Airfoil surface pressure distributions obtained 
from CFD simulations for the intermediate design 
(using 6 design variables). 
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Fig ire 5. Airfoil surface pressure distributions obtained 
fro 1 1 CFD simulations for the final optimal design using 
13 design variables. 



Figure 6. Band of airfoil surface pressure distributions 
obtained from CFD simulations used in training the 
neu al network for the hybrid approach. 








